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Camera to Tool 




Calibration of the camera mounted 
on the robot arm 



Position the camera on the robot arm so it is orthogonal to the 
"Calibration Model". Define the "Training Space" for the robot aligned 
with the template used for calibration 
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Compute camera intrinsic pararheters and the "Canhera Space-> 
Training Space" transformation 
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Compute "Camera Space Tool Space" 
transformation using the "Camera Space-> 
Training Space" transformation and inquiring 
the robot about the "Tool" position in "Training 
Space" 
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Teaching The Object Features & Robot Operation 

Path 



Place the object in the "Training Space" and capture an image 
with the robot in the calibration posftion (where the "Cannera 
Space-> Training Space" transformation was calculated) 
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Select from the image at least 5 visible 
features 
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Calculate feature 3D position !n "Training Space" 






Define an "Object Space " aligned with the "Training 
Space" but connected to the object and transform 
the 3D coordinates of the features in that space 
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Compute the "Object Space -> Camera Space" transfbrmatipn using the 3D 
position of the features inside this space and the position in the image by computing 
an extrinsic calibration using the camera calibration from previous step 
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Define an "Object Frame" inside "Object Space " to be used for teaching the 
robot operation path. Compute this Frame position & orientation in Tool Space " 
using the transformation from "Object Space-> Camera Space" and "Camera 
- Space -> Tool Space" . • 



t 

Send the "Object Frame " to the robot and train the 
robot operation path inside this space 



Object Positioning and Robot Guidance 



Position the robot in a predefined position above the bin 
with object.lf no object is in the field of view move robot 
until an anchor feature is found in the image 
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Use the position and orientation of anchor feature to 
compute the expected position of the rest of the 
features; Find the position of all the visible features in the 

image; 
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With the positions of features from the image and their 

corresponding positions in "Object Space" (calculated in the 
training session) use the camera calibration to compute the 
transformation between the "Object Space " and "Carhera 
Space ". Use camera extrinsic calibration. 
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Use the transformation from above to calculate the 

movement of the robot to position the camera so that it 

appears orthogonal to the object - same position. as in 
' training. In this way all the features will be as similar as 
possible to those at training. This will make the recognition 
and positioning more accurate. 
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Find "Object Space -> Camera Space" transformation the 

same way as in the previous step (using the features 
positions); Compute object frame memorized at training 
using the found transformation and "Camera Space-> Tool 
Space" transfomnation 
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Send the computed "Object Frame" to the robot; 
Use the "Tool" position to define the frame in "Robot 
Space"; Perform the trained operatin path on the object 
inside this space 



